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This essay summarizes the theory and practice of 
computer simulation, assesses the state of the art of simulation with 
respect to pedagogically relevant processes like learning, and 
speculates about the impact of such simulations on pedagogical 
research and practice. Arguing that the use of computer simulation as 
a technique for building formal models of mental processes forces the 
cognitive psychologist to consider the content of strategic or 
heuristic knowledge, the paper begins by discussing such 
philosophical concepts as the formalization of theories, the 
distinction between theories and models, and the notion of a research 
program. The rationale and workmode of simulation research are then 
summarized, and a review of the literature illustrates the range of 
phenomena with educational relevance to which the simulation 
technique has been applied. The new connectionist approach to 
simulation is described, and concern is expressed about the way in 
which knowledge appears in connectionist theories. The most direct 
interaction of computer simulation with education in the future is 
predicted to be through such computerized teaching tools as 
intelligent tutoring systems and systems for automatic cognitive 
diagnosis. It is concluded that a traditional science-to-practice 
knowledge transfer will occur to the extent that simulation models 
contribute to the improvement of psychological theories with 
pedagogical relevance, and that computerized teaching devices will 
have a dramatic effect on cognitive research methodology by providing 
access to information on the behavior of students in real learning 
situations. A list of 170 references is provided. (MES) 



ERLC 




COMPUTER SIMULATION AND ITS IMPACT ON 
EDUCATIONAL RESEARCH AND PRACTICE 



STELLAN OHLSSON 



• c 

• 0 



- Z 

In 

S- «^ 



I* 



! Is 
I 1 5? 



in f,!?s 



i* 0 

3.0 

~i Q 
U 



? ir, 



tint 



J ft 
«« 

U 

m 

lis 

IS 

> « 
* - 

Seo 



55* 



i ffl 
HQ 

mlii 

h 

n 

DC qj 
0CO 

to < 

5c . 

S III 

St n 



1 



1 



to 

UJ 
0 

(£: 

02 
(01 
UJ UJ 

t£ - 

no 

Is 

Oh 

UJ< 



2 



BEST COPY AVAILABLE 




3 



COMPUTER SIMULATION AND ITS IMPACT ON 
EDUCATIONAL RESEARCH AND PRACTICE 



Stellan Ohisson 



Learning Research and Development Center 
University of Pittsburgh 



1086 



To appear In International Journal of Education, In press. 



The research reported herein was conducted at the Learning Research and 
Development Center, funded In part by the National Institute of Education 
(NIE), U. S. Department of Education. Preparation of the manuscript was 
supported in part by an NSP grant and by a grant for the OERI Center 
for the Study of Learning. The opinions expressed do not necessarily 
reflect the position or policy of the sponsoring agencies, and no official 
endorsement should be inferred. 



Copyright © 1986 Stellan Ohisson 



2 



Computer Simulation 



Abstract 



The use of computer simulation as a technique for building formal models of mental processes 
forces the cognitive psychologist to consider the content of knowledge, In particular strategic or 
heuristic knowledge. The rationale and workmode of simulation research are summarized. A 
short review Illustrates the range of phenomena with educational relevance to which the 
simulation technique has been applied. Computer simulation and education are predicted to 
Interact in several ways In the future, most directly through computerized teaching tools like 
intelligent tutoring systems and systems for automatic cognitive diagnosis. 
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In the practical business of giving explanations-after all-scientists 
often enough rely not on the presentation of deductive 
arguments, but on such alternative activities as the drawing of graphs 
or ray-diagrams, the construction of intellectual models, or the 
programming of computers.... [The] primary thing to be learned, tested, 
put to work, criticized, and changed /is] the repertory of 
intellectual techniques, procedures, skills, and methods o f 
representation, which are employed in 'giving explanations 9 of events 
and phenomena within the scope of the science concerned. 

Stephen Toulmln, Human Understanding, pp. 157-150. 

Teachers, I am sure, strive to teach according to how learners learn. Their ambition is 
hampered, however, Dy our lack of knowledge about the psychology of learning. In the past, 
pedagogical applications have been derived from such disparate ideas as the behaviorlst concept 
of reinforcement (Giaser, 1978) and the plagetlan notion of stages of intellectual growth (Groen, 
1978), but they have been largely unsuccessful 1 . The art of teaching has been unable to turn 
itself into the engineering of instruction, for lack of a viable science of learning. 

In the last three decades, the information processing perspective has become the dominant 
point of view in the study of thinking, reasoning, problem solving, memory, learning, attention, 
perception, and other knowledge-related mental processes and functions (see, e.g., Anderson, 1980; 
Gardner, 1985). The central notion of this new psychology of cognition Is that knowledge resides 
in symbol structures in the head, and that mental processes consist of using, editing, or creating 
those symbol structures. The main goals of this essay are to summarize the theory and practice 
of computer simulation, to assess the state of the art of simulation with respect to pedagogically 
relevant processes like learning, and to speculate about the Impact of such simulations on 
pedagogical research and practice. 

Even though the psychology of mental symbol manipulations is a young creature, it now has 



See Good & Brophy (1088) for an up to date introduction to educational psychology. 
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offspring. One group of cognitive psychologists Is already changing the way we think about 
computer simulation by basing simulations on what we know about how the brain works, as well 
as on analyses of knowledge. This research orientation - often labeled "connectlonlsm" - uses the 
research lool of computer simulation within a new theoretical framework, producing simulations 
of a novel sort (McClelland, Rumelhart, & the PDP research group, In press a,b). This is an 
Interesting s«d Important development. The focus of this essay is nevertheless on what we now 
must caii traditional computer simulations, whfle connectlonlst simulations will be discussed only 
briefly. The main reason for this bias is that the application of connectlonlst research to 
education Is, by and large, yet to come, while computer slmulatlonlsts In general have payed 
considerable attention to classroom tasks in recent years. 

The purpose of the first section below is to remind the reader of some well-known but useful 
philosophical concepts, such as the idea of formalization of theories, the distinction between 
theories and models, and the notion of a research programme. The second and main section 
explains, reviews, and critiques the computer simulation programme, concluding that there are 
difficulties with It, some - but only some - of which could be overcome If researchers took the 
programme seriously. In a short section on the new programme of connectlonlsm I describe Its 
methodological advantages and express my concern about the way In which knowledge appears 
(or, rather, does not appear) within connectlonlst theories. I then turn to the question of what the 
pedagogical consequences of the computer simulation technique might be, reaching the conclusion 
that although simulation lends Itself to pedagogical purposes, the Impact of simulation research 
on educational practice will be slight. Instead, computer simulation makes It possible for 
educational practice to set the agenda for cognitive research. 

On Theories and Theorizing 
Theorizing is a complex activity, and theories have many aspects; let us illustrate them with 
a handful of metaphors. A scientific theory represents an effort at understanding. Its purpose is to 
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enable clear, coherent, and successful thinking about some part or aspect of the world. A theory 
is thus like a weave of ideas, its strength a function of how tight the strands are woven together. 
Penetrating behind the observable surface of the world, a theory postulates - creates, Invents - 
objects, processes, interactions, etc., such that if they were real, the surface characteristics of the 
world would have to be Just the way we observe them to be. A theory is thus like a fantasy or a 
dayc *am, albeit a very disciplined and purposeful one. If the world was described In a long and 
detailed text, a theory would be a statement of the main Ideas, the themes which underly the text 
as a whole. A theory is thus like an abstract. Once proposed, a successful theory is typically 
applied again and again to one phenomenon after another. If It continues to bring clarity and 
understanding, more and more phenomena will be seen as belonging to its domain. A theory is 
thus like a politically ambitious emperor, reaching out to conquer a larger and larger territory. 
The effort to extend a theory leads to the clarification of concepts, the sharpening of distinctions, 
and the exploration of alternative formulations and formalizations. A theory is thus like a crystal, 
steadily growing into its perfect form. 

Since theories deal with entitles which cannot be observed directly, theoreticians have a 
unique problem in communicating with each other: They must dispense with what philosophers 
call "ostenslve definitions 11 , I. e., they cannot point to Instances of what they are talking about; 
they cannot explain what they mean by showing examples. Since the sensory content of scientific 
terms is thus minimized, the rules by which those terms are combined becomes so much more 
Important. Scientific discourse takes on the character of a language game, the central terms 
becoming mere tokens fitted into standardized patterns of expression. 

It is not only hard to communicate about unobservabies, It is also hard to think about 
them. Ordinarily, we think within the context of the common sense knowledge about our world 
that we have collected by being participants in It. But none of us have gamboled with electrons 
and quarks as children, conversed at length with double helixes, or spent Sunday afternoons 
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observing patterns of activations spread across semantic networks. Reasoning about such entitles 
has to proceed without the safety net of common sense. 

Poth of these factors - the absence of concrete Instances of theoretical terms and the 
consequent lack of common sense knowledge about them - creates a strong tendency to formalize 
the scientific language game, to express the statements of a theory In a mathematical or logical 
calculus, so that the user of the theory need not rely on his intuitive understanding of Its terms 
(Tarskl, 1965). The rules of the calculus determine how the terms are to be used within the 
theory. Theoreticians can then focus their attention on the rules. The rules can, of course, be 
written down and so form concrete targets for agreements and disagreements. They can be 
discussed and constructively analyzed and investigated without universal agreement about exactly 
what intuitive content should be assigned to the terms they govern. Formalization also facilitates 
thinking. Mathematics, for Instance, can be seen as a huge set of abstract inference-patterns 
which have been thoroughly investigated and found to be valid. Expressing a scientific theory In 
mathematical symbols allows the scientist to draw upon and apply those Inference patterns while 
reason about his subject matter. A formal calculus supports thinking where common sense is 
powerless. In short, although formalization makes a subject matter incomprehensible to anyone 
who has no mastery of the particular formalism used, It nevertheless facilitates communication 
and collaborative thinking among the scientists who work with the theory. 

Scientific theories, like Ice-cream, come In different flavours. Throughout the diverse fields 
of scientific activity, different modes of knowing are employed, as they best fit the subject matter 
at hand (Toulmln, 1972). In some fields, it Is common to build a model of the system being 
studied. If we are studying a system S, then a model of S is some other system M which Is like S 
In some way. The question of exactly how M should be "like" S to be a good model Is a question 
of some complexity (Hesse, 1970; Shanln, 1972). A model M is not merely -similar" to the system 
S. If this were the case, It would be unclear how the model could be useful In Invectigatlng 
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S. What could we discover by studying M other than the very similarity between M and S which 
made us select M as a model of S In the first placef The answer is that a good model has to be a 
generative system, I. e., a system which produces behavior, results, products, etc., of some sort. 
By investigating ho* the model M works - what results It generates under different 
circumstances, how Its parts and properties Interact - and by hypothesizing that the system S 
works in the same way, we can Improve our understanding of S. 

The term "theory" is used In both a narrow and a wide sense. In the narrow sense, a theory 
consists of a collection of "laws" - principles, statements, assertions - and, possibly, proofs c? 
theorems, ail of which have logical relationships to each other. A theory in this sense Is basically a 
description, a text, even when expressed In some esoteric symbolism. A theory In the narrow sense 
contrasts with a model. A model is more like a replica; It represents the system of Interest by 
duplicating Its essential structure. It conshts of components which have functional relationships to 
each other. A model is basically a picture, even when drawn in some non-visual medium like a 
programming language. 

In the wider sense, a theory consists of both a set of principles and a model. The traditional 
astronomical theory of the solar system is an example. On the one hand, there Is a system of 
equations which describes how the heavenly bodies act on each other and from which one can 
derive descriptions of how they move. This Is a theory In the narrow sense. On the other hand, 
there is a geometric model of the solar system, consisting of spheres travelling along ellipses. The 
set of laws and the model together make up the astronomical theory In the wide sense. I will rely 
on context to make clear whether the term "theory" is used in the narrow or In the wide sense. 

Only rarely does a scientific theory spring fully developed from Its creator's head. More 
typically, a core Idea is born, Judged promising, and then worked out in an example. If the 
example is convincing, various developments follow. As the Idea - fledging theory, as it were - is 
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applied to new situations, other, auxiliary ideas are combined with It, already established theories 
are compared to It, alternative formulations of [t appear, efforts are undertaken to generalize it, 
etc. 

In popular accounts of science, the creation of new theories is often portrayed as the main 
activity In research. In philosophical discussions, empirical testing of theories tends to occupy 
center stage. But the bulk of a scientist's time is spent neither In Inventing theories nor In testing 
them, but in applying them. A theory is a complicated, abstrt;t description. It is often far from 
self-evident how It should be used In order to construct an explanation for a particular fact or 
event. For Instance, it took physicists more than two centuries to work out the many applications 
of Newton's theory of gravitation. 

The activity of developing and applying a theory is very complex, both Intellectually and 
sociologically (Toulmln, 1972). It is regulated by a paradigm (Kuhn, 1970) or a research 
programme (Lakatos, 1978), an "Ideology- or point of view, loosely defined, which is more or less 
shared among those who work with the theory. A research programme consists of beliefs about a 
theory - a rationale for why the theory is Interesting - and canons and conventions for working 
with that theory. It answers questions like the following: What is the core idea In the theory and 
which are the auxiliary ideas? What kinds of phenomena, and what kinds of observations of those 
phenomena, does the theory address? What kind of explanation does the theory provide? What 
counts as having explained something? When is an explanation successful? How can the theory be 
extended or Improved? WTiat form does progress take? What is the ultimate goal of the 
programme? What would count as "complete success"? Different programmes provide different 
answers to such questions for a particular field of research. In this essay, I am treating computer 
simulation as a research programme in the sense of Lakatos. 
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T*ie Computer Simulation Programme 

As noted In the Introduction, computer simulation models are currently used by two 
different, although related, research programmes within cognitive psychology. The older 
programme conceptualises cognitive processes as operations on symbol structures and builds 
simulations based on what we know about knowledge, while the more recent connections 
programme builds simulations based on what we know about the brain. The connections 
programme is reviewed in a separate section. 

Psychologists sometimes use the erm "simulation" to refer to computer programs which 
are not Intended as theoretical models, in some experimental studies, subjects are observed while 
Interacting with a simulation, e. g., a simulation of some complicated piece of machinery. In this 
case, the simulation is a model of the environment; It is a stimulus, or a technique for presenting 
a complicated stimulus. Also, some psychological theories are expressed in mathematical equations 
which are so complicated that they cannot be solved with the help of algebraic manipulations. In 
such cases, a computer program can be used to crunch out numerical solutions to those equations; 
such a program is often called a simulation 8 . In this essay, I will not discuss either of these two 
types of simulations. 

The present section is divided into four parts: a statement of the rationale of the simulation 
programme, a summary of the workmode Implied by that rationale, a select - and educationally 
biased - review of research Inspired by it, and, finally, a critique. 
The rationale 

The core conception behind the use of computer programs as models of human cognitive 
processes consists of three main ideas. The first idea is that knowledge-relevant processes such as 
perception, remembering, and thinking operate upon Internal symbol structures, I. e., sense- 



2 

See Loftut (1086) for critical commenU on tome ntes of this kind of timnlatiop. 
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Impressions, memories, concepts, thoughts, Ideas, Images, etc., which symbolize or represent the 
external world. This stance - so self-evident to common sense as to be almost Invisible for lack of 
contrasting alternatives - was rejected by behavlorlst psychology, but was re-asserted throughout 
psychology and related disciplines during the fifties and early sixties. The notion that Internal 
representations constitute the grist for the mental mill lies at the heart of modern cognitive 
psychology. 

The second Intellectual cornerstone of computer simulation is more technical and Its 
historical origin more circumscribed. It is the Insight that a computer has nc Intrinsic relation to 
numbers. The binary digits "1" and "0" which featured so prominently in early popularizations 
of computers can equally well be Interpreted as standing for "true" and "false", or even "up" 
and "down", as for the numbers one and zero. Furthermore, groups of binary digits can be used 
as a code for any other symbol one might care to use, such as, say, the word "table", the 
Implication-sign of formal logic, or the chemical symbol for oxygen. The computer is a general 
machine for operating upon symbols, any symbols. This conclusion appeared among a small 
number of Individuals during the fifties (John McCarthy, Marvin Mlnsky, Allen Newell, Herbert 
Simon, among others). Their names are well-known to us because their insight made research into 
Artificial Intelligence (A. I.) possible. 

The third and final step In the path to computer simulation as a psychological technique 
was taken by a team of three Individuals and was first published In a Joint paper entitled 
"Elements of a theory of human problem solving" (Newell, Shaw, & Simon, 1958). The paper 
combines the two previously described ideas: If human cognition operates on Internal 
representations, and If computers can manipulate arbitrary symbol-structures, then computer 
programs are candidate models of thought processes* 

3 The reader mifht want to compare the brief account fiven here with the more extensive discussion in the historical 
addendum in Newell ft Simon (1072, pp. 87&-880), and with Gardner (1086). 
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Wc should notice and dismiss two common misconceptions. First, a computer model is not a 
model of the brain, but a model of the mind (or the cognitive aspect of mind). Computer 
simulation models are not Interpreted In physiological terms like "brain cells", "electric 
potentials", etc., but in psychological terms like "knowledge", "attention", "memories", 
"thoughts", "beliefs", "concepts", "Intentions", "Inferences", "Insights", "skills", etc. 4 Second, 
the organization of a general-purpose digital computer is determined by very different 
considerations than that of modelling the human mind. Consequently, the model does not reside 
in the physical machine, but in the program. In short, the claim of the simulation programme is 
not that computers are like brains, but that the process of executing a stored program shares 
something essential with the process of thinking. 

To clarify what that shared essence Is, we must take a brief look at the nature of computer 
programs. Programming languages are not assertive or descriptive but czhortational languages. 
They are designed to facilitate clear and unambiguous statement of procedures. A program Is 
constructed by combining simple Instructions Into more complex ones, according to the rules of 
the particular programming language. Each Instruction exhorts the machine to manipulate some 
symbol-structure In some way, e. g., moving It, changing It, deleting It, etc. Complex Instructions 
are then combined Into even more complex Instructions, etc. A computer program is thus like a 
recipe, describing the procedure for, say, making apple pie, or a repair manual for an automobile, 
except that the objects being manipulated are symbols rather than apples or engines. From the 
psychological point of view, programs are like cognitive strategics: problem solving strategies, 
attentional strategies, rehearsal strategies, memorization strategies, retrieval strategics, etc., of 
which modern cognitive psychology is full. If we have a (sufficiently specific) hypothesis about 
what strategy a person is applying to some cognitive task, we can specify that strategy in a 
programming language. Since the computer can read and execute such a specification (as long as 

4 One feature of the new connectionitt programme it that itt practitioners do try to discuss their models in physiological 
terms. 
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the conventions of the particular programming language have been followed precisely), loading 
the program into the machine enables the machine to apply that strategy. Program execution and 
thinking are similar in that both processes consist in the application of a strategy to a task 
(Simon, 1981). 

A number of consequences follow from this basic conception. For instance, if a computer 
and a person are applying the same strategy to the same task, they should succeed and fall on the 
same problems. They should go through the same Intermediate stages or produce the same partial 
results. They should make similar errors under similar circumstances. They should find the same 
problems easy or difficult, respectively. These expectations form the basis for the empirical 
evaluation of simulation models, a topic which will be discussed further beiow. 

The simulation idea generates In-prlnclple or generic answers to the basic questions of 
cognitive psychology. Every theoretical programme in psychology, I claim, has to have In- 
principle answers to the following four basic questions: Why is one task more or less difficult than 
another (for a given Individual)? Why Is one and the same problem easy for one Individual and 
difficult for another? What is the nature of cognitive change? What aspects of cognition are 
invariant across tasks, across individuals, and over time? The generic answers provided by the 
computer simulation programme can be summarized as follows: 

1. Inter-Item differences. The generic explanation for task difficulty provided by the 
simulation programme is that one task requires more computations than the other. 
The amount of computation needed Is, In turn, a function of a number of factors, such 
as the structure of the mental representation of the task and the need to avoid short- 
term memory load (see, e. g., Kotovsky, Hayes, & Simon, 1985). 

2. Inter-individual differences. According to the simuiationlst's view, if two individuals 
perform differently on a task, then they are applying different methods to that task. 
The method can be analyzed Into the representation of the task, the cognitive 
operations applied to It, and the strategy which controls the application of those 
operations, any of which may be responsible for a particular difference (see, e.g., Just 
& Carpenter, 1985; Newell & Simon, 1972; Ohlsson, 1984a). 

3. Change. According to the simulation programme, cognitive change is the same as 
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revision of the knowledge-base in the head. Improvement In skills comes about 
through processes, so-called learning mechanisms, which revise - re-program, as It were 
- cognitive strategies (see Anderson, 1981a, and Klahr, Langley, & Neches, In press, /or 
collections of articles about the simulation of skill learning). Improvement In 
declarative knowledge comes about through storage processes which extend the datar 
base In long-term memory. Forgetting is conceptualized as either decay of stored 
information or as Interference between several pieces of Information at the time of 
retrieval (see, e. g., Kolodner, 1984). 

4. Generality. According to the computer simulation programme, It Is the "mental 
programming language", or, more precisely, the structure of the Information 
processing system in the head which remains Invariant across Individuals, across tasks, 
and over time (Newell, 1972; 1973a; 1973b). 

Current research In cognitive psychology consists, to a large extent, of attempts to work out the 
details of these generic answers for particular experiments, situations, or phenomena. 



The methodological advantages of the simulation technique can be organized into two 
groups, each group representing an Issue with several different facets. First, there is the Issue of 
completeness. If a simulation program solves a task correctly, then we know that the set of 
mechanisms In It are sufficient for the task. In the opinion of the slmulatlonlst, a psychological 
explanation must pass this sufficiency test before It can be seriously considered, I. e., before It is 
meaningful to compare It to empirical observations. If a subject solves an experimental task 
correctly, then the cognitive machinery In his head is thereby proven to be sufficient for the task, 
and, consequently, any explanatory machinery which is not sufficient is known to be Incomplete, 
even before It Is confronted with data. Sufficiency Is a logical criterion for the adequacy of an 
explanation, similar to the criterion of consistency with respect to theories In mathematical 
physics. (An Inconsistent set of equations is not an adequate physical theory.) Logical (as opposed 
to empirical) criteria for the adequacy of theories have not played an Important role In the 
history of psychology, so It is not surprising that the sufficiency argument seldom is carried out 
or mentioned In actual simulation work, although It figured prominently In the argumentation of 
the programme founders (Newell & Simon, 1965). 
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In another facet of completeness, the simulation programme emphasizes that human beings 
are complete agents. Strictly speaking, there are no "perceptual tasks", "memory tasks", 
"problem solving tasks", etc. Perception, memory, and thinking are Involved in every cognitive 
performance. It follows that there cannot be a theory of problem solving, or of memory, or of 
perception, because such a theory could not be tested against data; only complete systems, which 
have the entire range of capabilities (albeit, perhaps, In simplified form), and which shows 
explicitly the Interactions between them, only such theories, the slmulatlonlst claims, can be 
meaningfully compared to empirical data. 

Next, there is the Issue of application, which also has several different facets. One essential 
use of a theory or a mode! is to derive predictions from It. In the case of a simulation model, 
predictions can be derived by running the model on the computer. Thte a convenient and inter- 
subjectlvely valid way of deriving predictions to be tested In experiments. We can also apply the 
model to situations which we have not observed (and perhaps could not observe), and so predict 
what the simulated person would have done In those situations. Other kinds of thought 
experiments are also possible. For instance, Ohlsson (1980) deleted randomly selected portions of 
the knowledge-base of a simulation program. Runs with the so mutilated program showed that 
the smaller knowledge-base did not cause the program to have fewer correct answers on a 
standard set of problems, but that the program had to work more in order to reach those 
answers. One can Imagine running a simulation model under varying assumptions of short-term 
memory capacity, under assumption of perfect long-term memory recall, or under any number of 
extreme conditions, in order to Investigate the Implications of the principles embodied in It. 

In summary, the computer simulation programme starts with the idea that a human being 
who Is trying to cope with an Intellectual task is applying a strategy to that task. If the strategy 
can be embedded In a computer program, then the process of executing that program on a 
computer can serve as a model of the mental process of the human while solving that task. This 
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research programme provides generic answers to tne problems of why there are performance 
differences across problems, across individuals, and over time, as well as a principled conception 
of what remains invariant across those dimensions. The main methodological advantages of the 
simulation technique are that the medium forces the theoretician to produce complete 
explanations, and that the model, once constructed, can be applied to derive predictions and 
perform thought experiments. 
The simulationist's workmode 

Suppose that we have observed a particular person - a school child, a chess player, a doctor 
- while struggling with some Intellectual task - a subtraction problem, an end-game, a tricky 
diagnosis - and that It is our goal to explain the observed performance. What shape does this 
activity take? 5 

The slmulatlonlst will begin with task analysis, I. e., with an effort to acquire as thorough 
an understanding of the task as possible. This might Involve solving the task himself, perhaps 
repeatedly, and reflect on his own solution to It. It might Involve reading and studying the 
knowledge domain to which the task belongs, perhaps even Interviewing experts in the relevant 
field. What knowledge is necessary in order to handle the task? What knowledge Is useful? What 
would be a useful organization of that knowledge? What different methods apply v> the task? 
Eventually, the theoretician should be able to write a computer program for the task, execute it, 
and verify that it does, in fact, solve the task. 

Two important aspects of simulation research are already evident. First, the simuiationist 
must concern himself with the specific content of knowledge. Vague notions of "amount" of 
knowledge do not suffice for the writing of a program; the knowledge to be included in a program 
must be specified precisely. Second, the slmulatlonlst is likely to attend to procedural knowledge. 



The reader might wut to compare the description given here with Kierat (3086) and Young (1086). 
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The methods, strategies, heuristics, tricks, rules of thumb, shortcuts, tactics, recipes, routines, 
and procedures of the relevant domain are of central Interest because they constitute so many 
Ideas about how a pngram might operate. Again, vague notions of, say, "cognitive style" do not 
suffice; the methods to be Included In a program must be fuily specified. In short, the writing of 
programs forces the simulations to consider strategic knowledge, to consider the content of that 
knowledge, and to consider It in almost Insufferable detail. 

Once a running program has been constructed, the next task is to add psychological 
considerations. How do humans typically solve the relevant task? What changes should be made 
In the program to make It behave more like a person? When a first approximation has been 
achieved, it should be run on the same task as the human subject and a detailed trace of the 
program's behavior recorded. 

Next, there follows the comparison of the trace of the simulation model with the behavior of 
the simulated person. The success of the model is measured by how closely Its trace reproduces 
the observed performance. For Instance, If a program Is to be a good model of, say, a certain 
chess-player's skill, then It should certainly make the same chess-moves as that player when 
presented with the same chess-board configurations. Notice, in particular, that If the player 
makes mistakes, I. e., overlooks a strong move, then we would expect a good simulation model of 
him to overlook that same move. The basic evaluation principle Is that If the subject gives answer 
A (correct or Incorrect) to problem P, then the simulation model should produce answer A to 
problem P. 

Of course, one can write many different computer programs which produce a particular 
answer to a particular problem. The construction of a simulation model needs to be Informed and 
constrained by a wider data base than a single response. One approach to constraining model 
construction is to Increase the temporal density of Information about the particular performance 
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to be simulated by using detailed recordings or human performance, such as think-aloud 
protocols, recordings of eye-movements, and video-tapes of action sequences. The purpose is to 
achieve such a rich description of the performance so that differences between the computer trace 
and the human performance can easily be detected, and so that success on the part of the 
simulation is unlikely to come about accidentally. The evaluation principle used here Is that the 
greater the amount of detail the simulation can reproduce or explain, the better it is (Newell & 
Simon, 1972). 

A second approach to constraining a simulation model is to simulate performance on a 
range of related tasks. The purpose Is, again, to achieve such a rich description of performance 
that success in modelling is unlikely unless the model captures the essence of the underlying 
mental processes. The evaluation principle used here Is that the wider the range of performance.', 
a simulation can explain (at a given level of detail), the better it is (Kosslyn, 1980). Once the 
simulation model is confronted with data and the Inevitable discrepancies noted, the siir.ulationist 
enters into a sequence of successive revisions and re-comparisons, until the model has reached the 
desired level of accuracy. 

In summary, the shape of the research activity generated by the simulationist idea is as 
follows: (a) Select a task to study, (b) Analyze and study the task until it is thoroughly 
understood. Write a computer program which can solve the task, (c) Collect observations from 
one or more human subjects solving the same task, (d) Revise the program in the way suggested 
by the data, (e) Run the program and compare its trace with the behavioral record, (f) Ponder 
what the implications are of the mis-matches between the computer trace and the behavioral 
record, and try to revise the model so that It reproduces the behavioral record better. The 
criteria for a successful explanation are that the trace of the program reproduces the human 
performance in some detail. The longer and more complicated the performance and the closer the 
detail In which It Is reproduced, the better the simulation. Furthermore, If the model can 
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reproduce an entire set of related performances, then the larger the set, the better the simulation. 
The Issues Involved in the empirical evaluation of simulation models have been discussed by 
Kleras (1984, 1985), by Newell & Simon (1972), especially In chapters 5 and 6, and by Tuggle & 
Barron (1980), among others. 

The activity of constructing an explanation within the simulation programme Is a synthetic, 
rather than analytic, activity: an explanation Is achieved by Inventing and putting together a 
system, a device, which produces the event to be explained. Explaining is akin to designing. A 
model Is built by making choices on a number of design Issues (Moore & Newell, 1974), e. g., what 
knowledge the subject had, what method the subject was using, what aspects of the task he 
attended to, what Is the organization of the subject's knowledge, how are procedures represented 
in the subject's head, how Is procedural knowledge used, what memory stores are there and what 
capacity limitations, if any, are they subject to, etc. Each wulation model represents a 
particular combination of choices on these and similar Issues. A combination of choices constitutes 
a specification of the simulation program; computer Implementation of that specification Is 
analogous to the building of a physical device from engineering specifications. 

The function of empirical observations in this research programme is different from Its role 
In traditional experimental psychology. In a traditional study, the purpose of observing a person's 
performance Is to ascertain the effect of some stimulus varlatie on his responses. In the simulation 
programme, the function of empirical Investigations Is, broadly speaking, to describe human 
performance In as much detail as possible, In order to constrain model building. 

As the cycle of choosing tasks, observing human subjects, programming and testing models, 
continues, the simulation programme claims, we successively build up knowledge of what 
processes are necessary to accurately mimic human performance. In this research programme, 
knowledge takes the form of know-how. Advances in knowledge will show up In the form of 
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increased ability to construct successful simulations. In the end, the simulationlst claims, we will 
know enough about human cognition so that given only minimal Information about an Individual, 
we can quickly and easily put together a simulation model for his performance on some task, a 
model whlcl will simulate that performance to some chosen degree of accuracy. Analogous to a 
physicist who can predict the trajectory of a particle, given Its mass, Its speed, and the direction 
in which It Is moving, a slmulatlonlst will be able to predict a "cognitive trajectory", a solution 
path, given certain Initial parameters (e. g., the subject's representation of the task, his previous 
knowledge, etc.). 

Selected Review of Simulation Studies 

The computer simulation idea originated within the study of problem solving. Over the 
three decades since the original Newell, Shaw, and Simon (1958) paper, the range of problem 
solving tasks used In simulation studies has grown continuously. Some of these tasks are puzzles 
with little or no pedagogical Interest (e. g. Atwood, Masson, & Poison, 1980; Karat, 1982; 
Ohlsson, 1984b; Reed & Simon, 1976), but the last decade has witnessed a strong and growing 
trend to study class-room tasks, especially problems taken from mathematics and natural science. 
Detailed analyses of problem solving strategies is a hallmark of this strand of simulation research. 

A second strand of simulation research is Inspired less by ideas about thinking than about 
memory and language. Human long-term memory is a huge mass of diverse, Irregular, vague, and 
Incomplete descriptive knowledge which is typically extended, maintained, and used through acts 
of verbal communication, such as reading text or answering questions, and which Is prone to 
forgetting. The usr o f semantic networks of various types to describe this knowledge base and Its 
associated storage and retrieval strategies, and the willingness to Implement large systems, are 
hallmarks of this second strand of simulation research. 

In the following, I will briefly review four groups of simulation studies, three of which 
belong to the first strand described above, while the fourth group belongs to the second strand. In 
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a fifth and final miscellaneous group, I will mention some studies which do not fit neatly into 
either of the two main strands. The reader is warned against treating the present summary as a 
comprehensive overview. It is focussed on simulations with pedagogical relevance. 

Cognitive development. The computer simulation community turned Its attention to 
cognitive development early on. Several studies carried out In the seventies simulated chlldrens* 
behavior on classical Plagetian tasks, such as serlatlon of weight (Baylor and Gascone, 1874; 
Baylor, Gascone, Lemoyne, & Pothler, 1873) and of length (Young, 1876), classification and 
sorting (Klahr & Wallace, 1870), class Inclusion (Klahr and Wallace, 1872), conservation of 
quantity (Klahr & Wallace, 1873), transitive Inference (Klahr & Walter, 1876), object constancy 
(Prazdny, 1880), etc.. The choice of Plagetian tasks was natural, given the amount of interest in 
Plagefs work In the sixties and seventies. The approach of these studies was to make detailed 
observations of chlldrens* behavior at the various developmental stages, and then write a separate 
simulation for each stage. The sequence of simulation models as a whole constitutes a 
representation, a slide-show, as It were, of the growth of mastery of the task. By comparing the 
successive models In the sequent, one can describe the developmental advances In theoretical, 
rather than behavioral, terms. One major conclusion from this mlnl-tradltlon is that the 
differences In the details of cognitive strategies within so-called developmental stages are at least 
as dramatic as the differences across such stages. 

Although simulation studies of Plagetian tasks and phenomena are still carried out (see, e. 
g., Nason, 1886), current simulations of cognitive development generally show less of a Plagetian 
Influence both In the choice of experimental tasks and In the theoretical questions asked. Issues 
about problem solving strategies, task encoding, and working memory capacity are explored in 
the context of tasks ranging from arithmetic to the Tower of Hanoi puzzle, and to the debugging 
of LOGO programs (Carver & Klahr, In press; Klahr, 1885; Klahr & Robinson, 1881; Slegler, 
1886; Slegler & Shrager, 1884). 
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Most simulations in the field of cognitive development are not, strictly speaking, simulations 
of development, but simulations of chlldrens' (as opposed to adults') performance. They simulate 
performance at one or more stages of intellectual development, but they do not yet simulate the 
passage from one stage to another. The exception to this rule Is the work by Wallace, Klahr, and 
Bluff (In preu3), which attempts to design an integrated system capable, in principle, of 
reproducing human cognitive development. 

Performance models for educationally relevant problem solving tasks. Recently, 
simulationtsts have turned their attention to tasks which appear fn the curriculum. Mathematics 
provides a store of well-defined tasks at many different levels of complexity. Arithmetic (Ashcraft, 
1983; Briars & Larkin, 1984; Fletcher, 1985; Greeno, Riley, & Gelman, 1984; Hiebert & Wearne, 
In press; Klahr, 1973; Neches, 1981, 1982; Resnick & Neches, 1984; Riley & Greeno, 1980, Riley, 
Greeno, & Heller, 1983; Siegler, 1986; Siegler & Shrager, 1984; VanLehn, 1983), algebra, (Greeno, 
Magone, Rabinowitz, Ranney, Strauch, & Vitolo, 1985; Neves, 1978; Paige & Simon, 1965; 
Sleeman, 1982, 1984) and geometry (Anderson, 1981b, 1982; Anderson, 1983a; Anderson, Greeno, 
Kline & Neves, 1981; Greeno, 1976; Greeno, 1978a;) have all been targets for simulation efforts in 
recent years. Since the notion of an "error" comes naturally to the discussion of these domains, 
the design of computer programs which do mathematics Incorrectly has become a major research 
activity. Many studies try to account for errors by showing how they would arise from the 
execution of some mathematical procedure which deviates from the correct procedure in some 
precisely specified (and sometimes minor) way. A major conclusion of this research Is that errors 
cannot be thought of as resulting from missing knowledge only; incorrect mathematical strategies 
In students are not Just incomplete, they also contain "mal- rules", I. e., components which are not 
part of the correct skill (Anderson, Boyle, & Yost, 1985; Brown & Burton, 1978; Burton, 1982; 
Evertz, 1982; Ohlsson & Langley, in press; Sleeman, 1982, 1984; Young & O'Shea, 198i\). 

A second area of the curriculum which has been mined for simulation targets !s natural 
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science, especially physics problem solving (Bhaskar & Simon, 1977; Larkln, 1881; Larkln, 
McDermott, Simon, & Simon, 1880a, 1880b; Larkln, Relf, Carbonell & Gugllotta, In press). One 
approach used In this research b to simulate both a (successful) novice and an expert problem 
solver, and then characterize the differences between their solutions. One conclusion from such 
research Is that expert problem solvers In physics employ mental representations of problems 
which are specifically physical, while novices atiend too much, or too soon, to the mathematics of 
the problem. 

Human performance on non-academic but educationally Important tasks like typing, 
electronic trouble shooting, and the operation of complicated machines of various kinds (including 
computers) have also been Investigated In simulation studies (Anzal, 1884; Card, Moran, & 
Newell, 1883; Kieras & Poison, 1885; Rumelhart & Norman, 1882; White & Frederiksen, 1884). 
Such studies are about to mature Into a new kind of applied psychology with strong Implications 
for workplace design and personnel training. 

The acquisition of cognitive skills. Given a sequence of models each of which simulates a 
person's performance at different developmental stages or at different points In time, the next 
question to ask is what mechanisms affect the transition from one to the other. In the computer 
simulation approach, this question Is, of course, approached by Incorporating learning mechanisms 
Into simulation models. Computer learning is still a rather novel phenomenon even within the 
field of Artificial Intelligence, and running simulation programs which simulate how humans learn 
cognitive skills are few and far between. The volumes by Anderson (1881a) and by Klahr, 
Langley, & Neches (in press) cover a significant portion of the relevant research* . 

A small group of simulation studies have tried to model human learning In artificial task 
domains. Anzal and Simon (1878) simulated one person's successive mastery of the Tower of 

8 S«e Mitchell, Carbonell, ft Mlehaliki (1086) for an overview of relevant Artificial Intelligence research. 
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Hanoi puzzle. Langley (1683a, l^S) has applied a theory of discrimination learning to several 
puzzle tasks. In a similar effort, A&lssofl (Id press-a) simulated the acquisition of strategies for 
several puzzle tasks, as well as tye transfer of training from one jroup of problems to another 
within a very simple task domain, F^igeDbaum and Simon (1984) have proposed a general theory 
of learning to recognize patterns, fcufch as nonsense syllables. Rosenbloom and Newell (1986) has 
suggested a general scheme for Au^aa learning called "chunking" which has bee? used to 
simulate performance on laborato^ fcactfon-tlme tasks, with excellent fit to human data. Ohlsson 
(In press-b) has designed a learnl^ Onanism which simulates successive changes in the mental 
representation of a simple verbal ^a^nlng task, guided by general world knowledge. 

However, there Is also a h^bdful of studies simulating the acquisition of cognitive skills 
relevant to classroom tasks. John AAderson and coworkers have simulated learning to construct 
proofs in elementary plane geometfy (Anderson, 1982; Anderson, 1983a; Anderson, Greeno, Kline, 
& Neves, 1981) and to write slnyle computer programs (Anderson, 1988; Anderson, Farrell, & 
Sauers, 1984). Kurt VanLehn's sl^Uktion of the acquisition of the standard algorithm for multi- 
column subtraction takes Into ac^uAt an entire lesson-sequence, taking a lesson to be a set of 
solved examples and letting tbc ^toUlatlon program learn from them (VanLehn, 1983). Neches 
(1981, 1982) has simulated the dls^iy of the so-called MlN-strategy for simple addition 7 . Neves 
(1978) has simulated the learning algebra rules from solved examples. 

Learning, retaining, and renting declarative knowledge. The simulations discussed so far 
are all concerned with procedural ^wiedge, I.e., knowledge about how to act in order to reach 
certain goals. A second main str^d of simulation research Is mainly Interested In declarative 
knowledge, I.e., knowledge about what i s true of the world. The paradigmatic task in this 
tradition is to read a text (perhaj^ atxly * single sentence), and then, after some period of time, 



7 

Empirical research hu established that tyild*** ct * discover the MIN-strategy on their own (Groen St Resniek, 1077). 
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answer one or more questions about It. A simulation model for this task has to contain 
assumptions about how long-term memory Is organized, about fcow new knowledge is added to It, 
and about how Information Is retrieved from It. It Is desirable, albeit difficult and laborious, to 
provide such a simulation with a natural language front-end which models how people understand 
language and which allows the model to acquire Its knowledge by reading actual texts. This type 
of simulation model grew out of the Idea of semantic networks (Qullllan, 1868, 1888) and 
flourished In the seventies (Anderson, 1878; Anderson & Bower, 1873; Collins & Qullllan, 1868; 
Frljda, 1872; Klntsch, 1874; Miller, 1881; Norman, Rumelhart, & the LNR group, 1875; 
Rumelhart, Lindsay, & Norman, 1872; Schank, 1872, 1875; Schank & Abelson, 1877; Schank & 
Colby, 1873). The reviews by Frljda (1872) and by Chang (1886) provide further discussion about 
this strand of simulation research. 

One of the main results of research with simulation models based on natural language 
Interfaces and semantic networks Is that systematic and reasonable strategies for storage and 
retrieval of declarative Information can produce the kinds of confusions, transformations, and 
retrieval failures which are typical of human performance (Kolodner, 1883a, b, 1884). Another 
lesson from this type of research is that acquisition and utilization of declarative knowledge is 
always context dependent. For Instance, a question is answered differently depending on when 
and where It is asked, by whom, etc. The complexity of declarative knowledge acquisition may be 
responsible for what seems to be a recent decline In this strand of simulation research: current 
simulations of memory retrieval tend to shy away from Implementing the actual content of 
human long-term memory In favor of more abstract, and therefore more computationally 
tractable, models (Hlntzmann, 1884; Raajmaker & Shlffrln, 1881; Walker & Klntsch, 1885; 
Wlegerswa, 1882.). 

Simulations of long-term memory have, In principle, tremendous pedagogical relevance. In 
school subjects like history, geography, and social studies, "learning" Is, to a large extent, 
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"studying", I. e., acquiring mostly descriptive knowledge through reading or listening. The 
simulation models mentioned here contain explicit hypotheses about the acquisition, retaining, 
forgetting, and recalling of declarative knowledge. Clearly, such hypotheses must have 
Implications for how declarative knowledge should be presented to facilitate learning. However, In 
spite of their obvious pedagogical relevance, simulation models within this strand have so far not 
figured frequently In educational applications. One exception to this rule Is the work by Kolodner 
(1083c) In which she applies considerations of long-term memory to the investigation of how 
expertise In psychiatric diagnosis Is acquired. 

Miscellaneous. There are other simulation studies which deserve mention as well, although 
they do not fit neatly Into any of the above categories. Of particular Interest from a pedagogical 
point of view are simulations of reading (Just & Carpenter, 1984; Just & Thlbadeau, 1984; Kleras, 
1982, 1983; Thlbadeau, Just, & Carpenter, 1982). The efforts to simulate skill acquisition has 
spawned a handful of studies trying to simulate Initial language acquisition (Anderson, 1983b, 
chap. 7; Langley, 1982; Wolff, 1980). A particularly fascinating application of the natural 
language/semantic network approach to computer simulation Is the effort by Colby (1973, 1975, 
1981) to simulate neurotic and paranoiac thought processes. Another type of model tries to 
simulate human performance on various visualization tasks. This mini-tradition was initiated by 
Baylor (1973), has been Intensively developed by Kosslyn (1980, 1985), and continues to generate 
new Ideas about the mind's eye (Just & Carpenter, 1985; Morgan, 1983). Finally, the reader might 
be Interested to know that even such a difflcultrto-grasp process as daydreaming Is now being 
Implemented on computers (Mueller St Dyer, 1985a, b). 
Critique of the Simulation Programme 

Three decades worth of experience with ths simulation programme should be enough to 
form at least a tentative evaluation of It. A scholarly appraisal of the programme cannot be 
attempted here. What follows Is the view of one participant and practitioner. 
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It may at first glance seem as if the simulation programme has been spectacularly successful 
in furthering our understanding of cognition. Today, the entire field of cognitive psychology 
speaks the language of symbolic computation; the psychological journals are full of mental 
representations being encoded, stored, retrieved, and processed In ail manner of ways. However, a 
critique of the simulation Idea must distinguish between the Information processing conception of 
mental processes, on the one hand, and the simulation Idea proper, on the other. The value of 
seeing cognitive processes as symbolic computations is not in doubt; at least, it will vot be 
questioned here. 8 The question Is whether the simulation technique, I. e., the explanatory 
procedure which leads to implemented, runnable computer programs, provides additional 
advantages over and above the advantages of adopting the Information processing point of view. 

When the question Is posed In this way, the case for computer simulation Is weak Indeed. It 
Is difficult to think of a single example of a surprising, Important, or Interesting discovery which 
has been made by running a simulation model. It is equally difficult to think of an example of 
some dramatic prediction which has been made by a simulation program, a prediction which was 
subsequently born out by data. Nor Is It easy to state the principles presumably established by, 
say, the simulation studies mentioned In the last subsection. As far as this author knows, no great 
theoretical synthesis has been achieved by taking two simulation programs and combining them 
Into a new model with more predictive power than either of the parts. Finally, there seems to be 
little or no growth of consensus about what mechanisms one must postulate In order to have a 
reasonable simulation of a human thought process. 

These discouraging observations demand an explanation. We need to scrutinize the 
difficulties and disadvantages with the simulation programme, distinguishing as we do so between 
the following three questions: 

1. Have the practitioners carried out the programme carefully? 

g 

Connection if m does, to some extent, pose that question. 
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If the practitioners have been careless or neglectful or simply misunderstood the 
simulation technique, the lack of results would not speak against the programme Itself. 

2. To what extent have the practitioners been limited by their tools? 

Computer simulation can only proceed where Artificial Intelligence has cleared the 
way. If current programming techniques are Inadequate to capture some aspect of 
human knowledge, the failure to simulate that aspect cannot be chalked up as failure 
of the simulation programme. The limitations of the programme itself has to be 
distinguished from the limitations of our current resources for carrying It out. Q 

3. What are the inherent weaknesses, inconsistencies, and difficulties with the simulation 
programme? 

Keeping these three questions in mind, we turn to a brief discussion of the problems 
associated with, respectively, convenience code, disembodied processes, effort, brlttleness, 
empirical validation, restricted public access to models, and informal statement of theories. 

Convenience code. Any simulation program will contain code which helps make the 
program executable but which does not represent any psychological hypotheses. For instance, a 
simulation of chess playing might contain a routine which finds all legal moves in a chess board 
configuration. The psychologist may not have any hypotheses about how the simulated chess 
player finds the legal moves; the theory might be all about choosing between moves, once found. 
Thus, the psychologist writes any convenient piece of code which will accomplish the move 
finding task, and lets his theoretically motivated code select a move by operating on the output 
from the former. 

The problem Is that the motivated code and the convenience code Interact In producing the 
behavior of the program. We have no guarantee that the performance of the program depends in 
essential ways on the theoretically motivated parts of the code. For Instance, suppose the move 
finding routine Is faulty, so that it Ignores a certain class of weak but legal moves. The 



The situation here if similar to that which holds in physics. Physicists an dependent upon mathematical results in order 
to develop their theories - with the result that physicists sometimes make substantial contributions to mathematics. 
Similarly, psychologists with computer simulation on their agenda sometimes have to dig into front-line A. L research 
problems in order to develop the tools they need. 
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theoretically motivated move-choosing routine will never choose one of those weak moves, not 
because it is intelligent enough to avoid them, but because it never gets to consider them. The 
program "predicts" that tne chess player will never make that particular type of error. If this 
"prediction" is born out by observations, it will be taken as support for the theory behind the 
program, although it actually depends on the design of the convenience code. The definition of a 
"legal move" In chess is sharp enough so that the particular accident described In this illustrative 
example is unlikely to happen. But other, equally disastrous Interactions between motivated code 
and convenience code may be opaque enough to go unnoticed by the programmer. This problem 
has been discussed by Frljda (1867), Kleras (1885), and by Neches (1882). 

The architecture-program distinction was proposed by Allen Newell (1872; 1873a; 1873b) as 
a solution to this problem. He argues that slmulatlonists should create psychologically motivated 
programming languages In which to write their models. The very structure of such a language - 
Its architecture - should be based on psychological hypotheses, so that the programs written In it 
need not contain any convenience code. All code in a simulation program should, In principle, 
admit of psychological interpretation. 

The two most ambitious efforts to date to create psychologically motivated programming 
languages are the ACT architecture by John Anderson (1876, 1883b) and the Soar architecture by 
Laird, Rosenbloom, & Newell (1886). Approaching the problem In a slightly different way, the 
PRISM programming language is an attempt to provide a flexible architecture, In which certain 
aspects, e.g., the number of working memories, can easily be changed to accommodate changes in 
theoretical assumptions (Langley, 1883b). However, the call by Allen Newell to distinguish 
between architecture and program and to write simulation programs !n such a way that their 
every feature admits of psychological interpretation, this call has, to a large extent, gone 
unheeded. 
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Disembodied processes. A human being is a complete agent, capable of perception, 
thinking, remembering, motor action, and learnt- Clearly, ail these capabilities enter into the 
solution to any cognitive task; observable behavior is a result of the Interaction between them. 
Any explanation of behavior must describe the role of each process In that interaction. 

Psychologists, however, tend to be more Interested in one of these capabilities than In the 
others. When they turn to computer simulation, they, naturally enough, want to simulate the 
capability they are most Interested In. The result is often a simulation of what we might think of 
as a disembodied process. For .nstance, simulations of problem solving often ignore the question 
of how the subject's thinking Interacts with his long-term memory; what is the problem solver 
reminded of while thinking about the problem? Similarly, most simulations of long-term memory 
can answer questions through retrieval of Information, but not through problem solving. 
Simulations of either problem solving and question answering usually ignore Issues of learning. 
Yet another type of Incompleteness which is virtually universal is to Ignore the perceptual-motor 
Interaction with the environment. Simulation programs regularly assume that the entire task 
description is present and accessible in working memory, finessing the Issues of attention 
allocation and of physical manipulation of task materials. 

Taking a purist stance, I conclude that such simulations are useless, because we already 
know that the observable behavior of a person comes about through an Interaction between 
perception, memory, thinking, motor action, and learning. The predictions of a program which 
represents one of these processes remain Indeterminate until Its Interactions with the other 
processes have been specified. Every simulation should have a complete set of mental processes, I. 
e. f mechanisms for remembering, thinking, and learning, a (simulated) environment, and 
capabilities for perceptual as well as a motor Interaction with that environment. The simulation 
programme calls for simulations of agents, not of disembodied process*. 
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Effort. Writing a serious simulation model Is no small enterprise. Several months have to 
be spent analyzing the task, many more In Implementing a program which can solve It, and, quite 
likely, many more still In revising It until It actually mimics a human subject. If the target task is 
at all complex, considerable A. I. know-how might be needed to make a runnable program. 

This fact has unfortunate consequences for how the simulation programme Is carried out. 
First, there Is, quite naturally, a reluctance to explore alternative explanations oT a phenomenon. 
If getting one simulation model up and running Is laborious, the idea of doing It twice Is not 
attractive. To the best of my knowledge, no researcher to date has Implemented two radically 
different simulation models for the same set of observations and then compared them. 
(Comparisons between two different theories with respect to the same phenomenon Is, of course, 
standard procedure in other domains of science.) Second, there is a certain reluctance to make use 
of other people's models. I know of no example of a researcher constructing an explanation of his 
own data by re-Implementing somebody else's simulation model from the published accounts of It, 
and applying It to those data. (Again, using other researchers' theories In constructing 
explanations of new data is standard procedure In other domains of science.) 

The problem of effort has no radical solution. We can only hope that more powerful 
A. I. programming tools and accumulation of know-how within the simulation community will 
eventually shrink to reasonable proportions the amount of work that has to go Into each new 
simulation model. 

Brittltntaa. One of the major difficulties with A. I. programs at the current time is that a 
program which works well on one task often falls dramatically on conceptually similar tasks. 
Since computer simulation models are limited to what can be done with current 
A. I. progremmlng techniques, simulations are brittle as well. This has the unfortunate 
consequence of preventing thought experiments and empirical explorations of programs. Making 



ERIC 



33 



31 Computer Simulation 

changes In a program and then running It can be a frustrating experience, because it may turn 
out that the changes render the program Impossible to execute. Exploration of the generality of a 
model can be discouraging, because there may be precious little in the model which transfers to a 
new task domain. In short, applying the program to other problems than the ones it was designed 
for may turn out to be impossible. 

However, brittleness Is not a methodological problem, but a theoretical one; it Is a 
consequence of our ignorance of the nature of intelligence. If we understood how human minds 
avoid being brittle, we would also understand how to write non-brittle simulations. Understanding 
intelligence is, of course, our goal. Brfttleness and its associated difficulties are lot properties of 
the simulation methodology, but Indications of our progress, or lack of progress, with respect to 
our research agenda. 

Empirical validation. Perhaps the most commonly noted problem with simulation models Is 
that they are severely underdetermlned by the dat-j, they are applied to. For any model, It seems, 
one can think of an alternative model which accounts equally well for the data. The large number 
of assumptions In a simulation model and the complexity of their Interactions - so the argument 
goes - make It very difficult, if not downright Impossible, to test a model stringently against 
empirical observations. 10 

The first thing to notice about this argument is that the possibility of alternative 
explanations for a phenomenon is not a feature of the simulation programme, but an aspect of all 
scientific research. Since other branches of science have coped successfully with this difficulty, the 
argument does not have any force unless it can be shown that the problem of choosing between 
rival exp.anatlons is inherently more severe with simulation models than with other kinds of 
theories. No such demonstration has yet been provided. 

10 John Anderson bu argued that this is necessarily so; see Anderson (1070). 

ERIC 34 



32 Computer Simulation 

The second thing to notice is that current practice with respect to empirical validation of 
simulation models Is unsatisfactory. The use of temporally dense behavioral records like think- 
aloud protocols (Ericsson & Simon, 1684), eye-movement recordings (e.g., Just & Carpenter, 
1985), and video-tapes of actions (e.g., Klahr & Robinson, 1981) Is still uncommon. Even worse, 
when those methods are used, the sequential information they contain Is usually destroyed by 
categorization or aggregation procedures of various kinds. Since the main difference between two 
different models for the same task is the sequence of intermediate results that they produce, 
ignoring sequential information is fatal. Furthermore, the methodological insight that it is a more 
challenging task to simulate a single performance in detail than to simulate the global 
characteristics of average performance (Newell & Simon, 1972) has largely gone upuotlced. 
Cognitive psychology has adopted the theoretical tool of computer simulation, but It has, by and 
large, not adopted the associated empirical methodology of temporally dense recordings of single 
performances. 

It appears, then, that simulation models are more underconstrained by data than they need 
to be. The empirical validation of simulation models Is a problem, not because of difficulties 
peculiar to the simulation programme, but because of the nature of scientific research in general 
and because of the reluctance of psychologists to adopt the empirical methodology that was 
invented for that very purpose. 

Restricted public access to models. A computer program Is not easy to read, its code I: 
usually too voluminous to publish, and it Is sometimes difficult to get a program developed on one 
computer to run on another. Consequently, simulation models are essentially private. They are 
described In scientific publications, but they are seldom used in a serious way by others than their 
creators. To some critics, this feature of simulation contradicts the public nature of scientific 
knowledge (Prijda, 1907; Neches, 1982). 
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This criticism is correct in Its statement of the facts and It Indicates a serious difficulty with 
the simulation programme, but I think the critics have misinterpreted the nature of that 
difficulty. To clarify the issue, we have to make use of the distinction between theories and 
models. A model does not, In and of Itself, represent knowledge. A model Is a particular, in 
philosophical terminology; In fact, being Itself a thing, It is every bit as particular as the thing it 
models. A simulation model does not "say" anything at all about human cognition; it does not 
make pronouncements or assertions; like all other objects, it just exists. The activities of 
designing, Implementing, and applying a model can help produce knowledge, but that knowledge 
resides In the head of the model-builder, not In the model. It Is certainly essential to make that 
knowledge publicly accessible; It is more doubtful If the same is true of the model Itself. 

Consider the double-helix constructed by Watson and Crick as a model of the DNA 
molecule (Watson, 1968). in no sense was the model itself- the rickety construction of differently 
colored pieces of metal - made public. They did not ship It to other laboratories, nor would such 
a road show have served any purpose. Concrete, physical models used In scientific research are 
usually private. The Important thing is that the corresponding theory is given public expression. 

In summary, the criticism that simulation programs are private tools is true, but It makes 
the wrong point. It treats programs as If they were theories rather than models. A model may 
remain private, as long as the theory It embodies does not. As we shall see below, the crux of the 
matter is exactly how to make the theory public. 

Informal statement of theories. A programming language is a formal notation in which 
one can describe a concrete model of Information processing. However, there is no corresponding 
formal language for expressing the theory behind that model. Therefore, slmulatlonlsts are forced 
to use the only resource available, namely natural language. The psychological principles which 
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guide the construction of the formal models are themselves Informally stated. 11 

This has several consequences. First, it Is unclear by what criterion a model Is Judged to 
Instantiate a particular theory. If two researchers disagree whether a certain model embodies 
such-and-such a theory, how would one decide the Issue In a disciplined way? (This difficulty 
raises the same question as the problem of convenience code discussed above: how do we know 
that the runs of a particular simulation program are relevant to the theory we are Interested In?) 
Second, since the theory behind a simulation model is stated Informally, we cannot expect the 
simulation technique to produce the advantages of formalized theory construction that were 
mentioned in the introduction. 

Thus, the simulation programme is radically Incomplete. It provides a methodology for the 
construction of concrete models of Information processing mcehaniems, but It does not provide a 
tool for the statement and analytical treatment of Information processing principles. What is 
needed is a high-level, formal, so-called specification language in which psychological principles 
can be stated and deductively analyzed and from which specific simulation models can be 
generated in a systematic way. 12 

Hagert (1986) has proposed a solution to this problem, based on logic programming 
techniques. In his method, a program specification (I. e., a theory) is stated In formal logic. 
Procedures (I. e., modeta) which satisfy that specification can be generated by deduction. The 
procedures are directly executable in the Prolog programming environment, so they can be run 
and empirically validated. The deductive derivation of a procedure (model) from a specification 
(theory) ensures that (a) the procedure satisfies the specification, and (b) that ail the assumptions 



U The reader may want to co-firm (his by, e. g. f looking at Chapter 14 of Newell and Simon (1072), where they ftate their 
theory of problem solving . or the statement by Anderson (1083b), pp. 17-30, of the ACT theory. 



ll The 



Dew approach of eonnectionism has such a two-layered theoretical methodology. 
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behind the procedure have been stated explicitly. Hagert (1986) has applied this method to the 
simulation of a simple short-term memory ta?k. It remains to be seen whether the method is 
useful in the construction of more complicated simulation models. 

Summary. Although the simulation programme, as distinct from the Information-processing 
point of view, has ad a dramatic effect on psychological research, It has not been a spectacularly 
successful enterprise. This Is due, in part, to the fact that Its practitioners have not carried out 
the program carefully, and, In part, to limitations on the available programming tools. However, 
the main weakness Is that the simulation programme Is radically Incomplete. It offers a technique 
for building concrete models, but no methodology for stating In a precise form what we learn 
from building those models. We can only express the theories we arrive at In Informal language. 
Consequently, research within the simulation programme does not benefit from the advantages of 
formal theorizing. 

Connectioniam: The Return of Mathematics 

Some cognitive psychologists are currently engaged In working out a research programme 
which might supersede computer simulation as described on this essay. This new research 
programme Is commcaly known as eonnectionitm (Feldman & Ballard, 1982). The reader Is 
referred to Hlnton and Anderson (1981) and McClelland and Rumelhart (In press a, b) for 
repiesentative works, as well as to the special issue of the journal Cognitive Science (Volume 9, 
Issue 1, 1985). 

The connectlonlst approach Is based on the Idea that we should use what we know about 
the brain, as well as what we know about behavior, when we try to simulate the mind. Perhaps 
the most basic observation one can make about brain activity Is that many parts of the brain are 
active at any one time. This leads to a conception of distributed Information processing, where 
many processing units operate In parallel. According to this view, information processing In the 
head is being done by "small" units, each of which performs a very simple processing task, like 
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computing the sum of the strengths of its inputs, and then transmits a signal to a certain set of 
other such units. There *re many units, each of which has a large number of connections to other 
units. The units ail act locally, on their own inputs only, so they can operate In parallel. The 
network of units is characterized by rules which regulate the connections between units, the type 
of computation being performed by each unit, and the kind of signal sent from one unit to an 
other. A learning theory In this programme consists of a set of rules for how the units should 
change their characteristics, e. g., wMch signal to send, as a result of their own activity. An 
Information processing system built along these lines Is rather different In character from the 
symbol manipulation systems considered so far in this essay. 



How would connectlonlsm answer the four questions I used to introduce the traditional 

simulation programme? 

1. Inter-Item differences. A connections theory Is well suited to describe task differences 
which are due to Interference effects and confusion; Indeed, explaining such 
phenomena is Its paradigmatic application. When It comes to large differences in 
performance, It is less obvious how the connectlonlst type of theory applies. Why, for 
instance, should one Isomorph of the Tower of Hanoi problem take 16 times longer 
than another to solve (Kotovsky, Hayes, & Simon, 1985)? Why Is the "envelope" 
version of Wason's so-called selection task so much easier to solve then the "card" 
version (Evans, 1984)? 

2 Inter-lndlvldual differences. There are no particular conceptual tools within the 
connectlonlst scheme to explain differences between individuals. 

3. Change. Connectlonlsm regards learning, or change over time In general, as a central 
characteristic of cognition. A connectlonlst learning theory consists essentially of a rule 
for how to change one or more of the characteristics of a processing unit, as a function 
of the Inputs It has received in the past. 

4. Generality. The Invariants of the mind In the connectlonlst programme are the 
network of units, the function which maps the Input signals onto an output signal, and 
the rule for how to change that function. 

In short, the connectlonlst p*r gramme has principled answers to the questions about change and 
about Invariants, but does not handle differences between Items or between Individuals well. 



Methodologically, the connectlonlst approach has two strong advantages over the 
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-traditional- computer simulation approach. First, It combines formal modeUuilding with 
formal theorizing, m a way which computer simulation as described earlier does not do. 
Connectlonlst models can be Implemented on a computer and simulation runs, Just like other 
simulation models. But due to the uniformity of the processing units and the simplicity of the 
computations they perform, the behavior of an entire connectlonlst network can be described and 
analysed with mathematical tools. Thus, there Is a formal way of stating the general properties of 
connectlonlst computer models. 1 * 

The second methodological advantage of connectlonlsm Is that It can use both behavioral 
and neurophyslologlcal data to constrain model-bulldlng. As noted in a a previous section, one of 
the problems with computer simulation models Is that they are obvloujly underdetermlned by the 
empirical data they are Intended to explain. By letting their simulation models be models of brain 
activity, the connectlonlsts make it possible to apply what is known about the brain to constrain 
those models. 

The practitioners of the connectlonlst programme characterise their object of study as the 
"micro-structure of cognition". The tasks they have studied are mostly perceptual-motor and 
short-term memory tasks. This accords with a long tradition in psychology of studying tasks for 
which one's theoretical approach seems to have the highest face validity: perceptual-motor 
processes obviously happen in parallel and in a distributed fashion. The educational Implications 
of a deeper understanding of human performance on these tasks are not obvious. Application of 
connectlonlst modelling techniques to tasks like proof finding in geometry and learning the history 
of World War II Is yet to come. 

The most disturbing aspect of connectlonlsm is the fact that It, once again, takes the 



**Tke technique of doing a mathematical description of a eompater .imaletion programme ha* ebo been nsed in 
connection wHh more traditional rimnlation program, which ^called .prcad of activations, of if me^rv r,Sv5 
proeetMc; tee Andenon (1084) md Anderwn ft Pirelli (1884). memory retrieval 
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knowledge out of the theory of cognition. The point of the connectlonist approach - and its most 
fascinating aspect - is that It describes a type of system in which knowledge has no location, in 
which knowledge is spread out among a large number of units, and In which knowledge only 
exists in so far as the entire set of units reacts as a whole in particular ways to particular 
situations. Consequently, connectionlsm does not provide any tools for the analysis of knowledge. 
We cannot, for instance, command a computer to print out a connectlonist model and expect to 
find Its knowledge in the print-out; the only thing that can be printed Is a very long list of 
connections with their associated strengths, as incomprehensible as the brain itself. Thus, 
connectionlsm takes an anti-representational stance. There are no mental representations In the 
head, no symbols which refer to the external world, nor any cognitive strategies. To the extent 
that the post-war advances in our understanding of cognition are du« to thinking of mental 
processes in terms of operations on internal representations, under the guidance of heuristic 
knowledge to that extent those advances are lost again In the connectlonist programme. 
Impact of Simulation on Educational Research and Practice 
Three decades of research have produced some knowledge about how to design simulation 
models of cognitive processes. What Impact will this ability have on educational research and 
practice? 14 The question turns out to have several layers, a methodological layer, a theoretical 
layer, and a technological layer. Each layer will be discussed below. The final conclusion is that 
the main consequence of bringing cognitive psychology into contact with education is that 
practice gets a chance to influence research, rather than the other way around. 

The computer simulation technique has two methodological consequences which contribute 
to Its educational relevance. The first Is that tasks used in psychological experiments are now 
chosen on the basis of inherent interest. Experimental tasks used to be chosen on practical 

14 The broader ques tlon of whit the implications in for education of modern cognitive psychology in general (rawher than 
just the simulation technique per se) has been considered by Gagne (1096), Frederiksen (1084) and Ohlsson (1083); see abo 
the collection of articles by Tuma St Roofs (1080). 
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grounds: They were convenient to administer, involved cheap materials that could be 
systematically varied, demanded responses that could easily be registered, etc. Presumably, the 
practitioners of traditional experimental psychology believed that since they were Interested In 
general laws of behavior, they did not have to pay attention to the particular properties of any 
one task. A psychologist Interested in computer simulation, however, must attend to the 
particular content of the mental representations and processes involved In solving the 
experimental task. Consequently, selecting an Interesting task has become a central step In the 
posing of a cognitive research problem. Since educational relevance Is one ground for regarding a 
task as Interesting, a significant proportion of current cognitive research concerns tasks which 
appear In the curriculum or In training programs of one form or another. Cognitive psychologists 
now do their research on the very same tasks which teachers try to teach. 

A second educationally Interesting consequence of the simulation technique Is the new 
willingness of psychologists to study single subjects. The experimental psychology of, say, 
1920-1960 dealt almost exclusively with averages over groups of subjects." But educators benefit 
very little from knowing that people in general have such-and-such characteristics. Educational 
practice depends upon the ability to react properly to particular Individuals. The simulation 
technique allows single Individuals to be studied and modelled, which makes It relevant for 
questions like "What does this student know?'", "Why did this student make that error? 
"What kind of Instruction does this student need?", etc. 

Taking the relationship between physics and chemistry, on the one hand, and engineering 
science, on the other, as our analogy, we would expect that better theories about human cognition 
In general and about human learning In particular would lead to changes In educational practice. 
According to this view, the Influence of the simulation technique on education world be Indirect: 



1S B*fore that time, analy** of singU subjects wen more common. Thui, in this respect, modem cognitive psychology it 
returning to an earlier methodological stance; see Dukes (10*5). 
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as a research tool, it will contribute to better theories of human cognition, and these, in turn, will 
contribute to the improvement of instruction. 

Examples of such influences at the theoretical layer are not hard to find. For instance, 
consider the notion of an arithmetic error. Due to the research by Brown and Burton (1078) and 
Burton (1082), the vague idea of an arithmetic algorithm not being properly "fixed" in memory 
has given way to the notion of a "buggy procedure". The latter obviously derives from the 
conception of cognitive skills as analogous to computer programs. Computer implementations of. 
buggy algorithms constitute concrete, detailed, and precise descriptions which can be used to 
predict the behavior of a student who is the victim of a particular error. The increased 
understanding of cognitive errors produced by such simulations facilitate a precise discussion of 
how to diagnose errors and what remedial instruction to provide. 

As a second example, consider the question why cognitive skills are difficult to learn. 
Anderson's (1082, 1086) theory of knowledge compilation show and expect him to apply to it 
immediately, rule, say, and expect him to apply It Immediately. The translation of a verbally 
stated piece of advice Into an executable procedure which Interacts correctly with previously 
existing procedures is seen to be a complex process, once we try to spell It out In a computer 
simulation. Similarly, VanLehn's (1083) theory of procedure induction explains why a student 
might arrive at the wrong algorithm as a result of studying correctly solved examples: The 
induction of the correct procedure from the examples presupposes knowledge of what the relevant 
properties of the examples are, knowledge which students do not always possess. 

In short, the simulation technique does contribute to an improved understanding of the 
cognition of classroom tasks, with implications for instruction. However, such knowledge transfer 
is slow and uncertain; teachers do not always pay attention to research results, and researchers do 
not always communicate them well. Also, scientific breakthroughs do not occur every day. This 
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form of interaction between research and pedagogy is weak and the effects are likely to be small, 
at least in the short run. 

However, science does not only - and perhaps not primarily - influence human activity 
through the spread of new knowledge, but through the technologies supported by that knowledge. 
The main Impact of simulation on pedagogy, I suggest, will be mediated by the teaching devices 
of various kinds which are soon to be appear In classrooms. Current know-how supports two 
types of devices which have computer models as essential Ingredients: systems for automatic 
cognitive diagnosis (Anderson, Boyle, & Yost, 1085; Attlsha & Yardanl, 1984; Burton, 1982; 
Johnson, 1985; Johnson & Soloway, 1984; Marshall, 1980, 1981; Ohlsson & Langley, In press; 
Reiser. Anderson, & Farrell, 1985; Sleeman, 1982, 1984) and Intelligent tutoring systems 
(Anderson, Boyle, Corbett, & Lewis, 1988; Anderson, Boyle, & Reiser, 1985; Beakley & Haden, 
1985; Sleeman & Brown, 1982; Wenger, 1985). Such devices are beginning to appear In schools 
and their presence there will grow more frequent over time. 

Like any other type of tool, these tools will shape the activity In which they are used. To 
clarify the nature of this effect, let us consider, as an Illustrative example of a socially influential 
technology, that ever-present communication tool, the telephone. The effect of the telephone on 
our communication habits is a result of the functionality of the device, not of Its scientific 
underpinnings; the telephone does not Influence people by making them think of electricity as 
they dial, nor is r'.de-spread understanding of, or even belief In, the theory of electricity a 
necessary condition for the telephone to have an Impact. Similarly, the new teaching devices will 
shape Instruction In ways which depend primarily on the activities that the devices allow. For 
Instance, intelligent tutoring systems can monitor practice in a constructive way, freeing the 
teacher from the task of correcting essays and worksheets; while systems for automatic cognitive 
diagnosis enable a teacher to have a detailed picture of the knowledge state of each student In her 
class. We do not yet know what effects such devices will have on teaching. The point argued here 
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Is that the effects, whatever they turn out to be, will be caused by the functions of these tools - to 
monitor practice, to perform cognitive diagnosis - rather than by the content of the psychological 
theories which motivate their design. Furthermore, the appreciation of those functions does not 
presuppose a general understanding of the underlying theories. Hence, the slowness of knowledge 
transfer between the research community and the practitioners does not limit the impact of such 
devices on education. 

The discussion so far has asked the question of how simulation might influence education. I 
now want to argue that the teaching devices made possible by computer simulation open up a 
channel through which educational practice might come to decide the fate of psychological 
theories and set the agenda for psychological research. Consider the fact that tutoring systems, 
once placed in the classroom, constitute the most efficient tool for collecting precise and 
ecologically valid observations about human cognition that has ever been devised. Unprecedented 
amounts of empirical Information can be collected with very little effort. We can foresee at least 
the following effects on research: 

1. New learning phenomena will be discovered. It would be truly surprising if data 
collection on the ^aie that is now becoming possible did not reveal previously 
unnoticed regularities hi, human learning. 

2. The probability that educational research will be side-tracked by artifactual 
experimental effects will decrease. A proposed regularity or phenomena can be checked 
against a vast, c ically valid data-base. 

3. Interest in labora „ studies will decline. What educational researcher - Indeed, what 
cognitive psychologist - does not prefer to collect his data in the classroom? Why not 
use ecologically relevant data if they are available? 

\. The sheer amount of empirical material reported in each Journal article is iikeiy to 
increase. In the long run, the standards of journal reviewers and editors will be 
affected. 

5. The type of tudiei performed are likely to change. On the one hand, data collection 
in the classroom favors descriptive studies, because many aspects of classroom activity 
cannot be varied systematically for *he sake of an investigation. 

On whe other hanc, intelligent tutorial systems can be programmed to teach with 
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different teaching strategies, and they are guaranteed to execute a particular teaching 
strategy faithfully. This enables well-controlled experimental evaluations of teaching 
strategies, as well as experimental tests of theoretically derived predications about the 
effects of different teaching strategies on the behavior of the learner. Perhaps 
"teaching strategy" will become the major Independent variable In future psychology 
experiments. 

6. If most psychological observations are collected In the classroom, the only way for a 
theory to be Impressive is to handle those observations. Classroom behavior, rather 
than laboratory behavior, will become the main testing ground for theories of 
cognition. (See Anderson, Boyle, Corbett, & Lewis, 1986, for a similar opinion.). 

At the present time, these effects of computerized teaching devices on cognitive research are Just 
beginning to be noticeable. 15 



In summary, the Interactions between the simulation technique and educational research 
and practice are complex. The simulation technique forces researchers to consider the content of 
their subjects' knowledge and provides a format for theorizing about individual subjects. Both of 
these features contribute to the pedagogical relevance of cognitive psychology. We can expect a 
traditional sclence-to-practlce knowledge transfer to occur to the extent that simulation models 
contribute to the improvement of psychological theories with pedagogical relevance. But 
simulation know-how also facilitates the construction of computerized teaching devices. Like ail 
other tools, these devices will shape the activities In which they are being used through their 
functionality, rather than through their scientific rationale. Finally, these devices constitute a 
channel through which the behavior of students in real learning situations become available to 
researchers, with dramatic effects on how cognitive research is carried out. 



"interestingly, O'DeU ft Dickerson, (1084), make a ■Imiiar argument for the usefulness 0 f fyitemi for computerised 
psychotherapy snch ad the ELIZA program. 
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